arXiv:1502.00197vl [cs.NE] 1 Feb 2015 


An Inter-molecular Adaptive Collision Scheme for 
Chemical Reaction Optimization 


James J.Q. Yu, Student Member, IEEE and Victor O.K. Li, Eellow, IEEE 
Department of Electrical and Electronic Engineering 
The University of Hong Kong 
Email: {jqyu, vli}@eee.hku.hk 


Albert Y.S. Earn, Member, IEEE 
Department of Computer Science 
Hong Kong Baptist University 
Email: albertlam@ieee.org 


Abstract —Optimization techniques are frequently applied in 
science and engineering research and development. Evolutionary 
algorithms, as a kind of general-purpose metaheuristic, have 
been shown to be very effective in solving a wide range of 
optimization problems. A recently proposed chemical-reaction- 
inspired metaheurlstlc, Chemical Reaction Optimization (CRO), 
has been applied to solve many global optimization problems. 
However, the functionality of the inter-molecular ineffective 
collision operator in the canonical CRO design overlaps that 
of the on-wall ineffective collision operator, which can potential 
impair the overall performance. In this paper we propose a new 
inter-molecular ineffective collision operator for CRO for global 
optimization. To fully utilize our newly proposed operator, we 
also design a scheme to adapt the algorithm to optimization 
problems with different search space characteristics. We analyze 
the performance of our proposed algorithm with a number 
of widely used benchmark functions. The simulation results 
indicate that the new algorithm has superior performance over 
the canonical CRO. 

Index Terms —Chemical reaction optimization, global opti¬ 
mization, inter-molecular operator, evolutionary computation, 
meta-heuristic. 


I. Introduction 

C hemical Reaction Optimization (CRO) H] is a recently 
proposed population-based general-purpose metaheuris¬ 
tic optimization method. CRO mimics the interactions and 
transformations of the reactant molecules in chemical reactions 
to search for global optimums El. CRO was designed as 
a general framework for optimization, and it was initially 
proposed to solve combinatorial optimization problems ID- It 
has been applied to solve a wide range of classical and real- 
world discrete problems, e.g. Quadratic Assignment Problem 
m, Sensor Deployment Problem 0, and Unit Commitment 
Problem 0. CRO demonstrated outstanding performance in 
these problems and was shown to be both effective and 
efficient in solving similar combinatorial problems. 

Based on the CRO optimization framework, Lam et al. 
proposed a variant of CRO, named Real-Coded Chemical 
Reaction Optimization (RCCRO), to solve continuous opti¬ 
mization problems Q. RCCRO has four different operators for 
the elementary reactions to facilitate the optimization process 
(the details will be introduced in Section E- The encod¬ 
ing scheme, boundary handling scheme, and other ancillary 
schemes were also devised. RCCRO has also been applied 


to solve different benchmark and real-world problems, e.g. 
training artificial neural networks ii, Optimal Power Flow 
problem fT), and Cognitive Spectrum Allocation problem 0. 
We also conducted research on exploring the nature of differ¬ 
ent operators in RCCRO. In our previous work, we attempted 
to use different probability distribution function to replace the 
Normal distribution adopted to perform neighborhood search 
0, and the results show no significant preference over the 
four distributions studied. 

In the canonical design of RCCRO, the inter-molecular inef¬ 
fective collision operator is largely similar to having two on- 
wall ineffective collisions occurring simultaneously, and the 
only difference between inter-molecular and on-wall ineffec¬ 
tive collisions is their different energy handling schemes. This 
design can significantly alleviate the implementation effort 
as the neighborhood search operator, i.e. on-wall ineffective 
collision operator, is re-used. However, a potential drawback 
of this implementation is that the functionalities of these 
two elementary reactions overlap, which may lead to wasting 
the limited function evaluations. Moreover, the neighborhood 
search operator in the canonical RCCRO alters the value of one 
dimension of the input solution, which can effectively solve 
problems with minimal inter-dimensional correlation. But it is 
not efficient at solving problems with strong inter-dimensional 
correlation such as rotated functions. In order to resolve these 
drawbacks, this paper focuses on proposing new operators and 
schemes based on the canonical RCCRO framework. 

The rest of this paper is organized as follows. We introduce 
the canonical design of the CRO framework and the RCCRO 
design in Section |I^ The newly proposed inter-molecular 
ineffective collision operator and the adaptive collision scheme 
is presented in Section III Section IV introduces the experi¬ 
mental setting we employed to analyze the performance of our 
algorithm as well as the simulation results and discussions. 
Finally this paper is concluded in Section [V] with some 
potential future research. 


II. Chemical Reaction Optimization Framework 

In this section we will introduce the general framework 
of the canonical CRO and some implementation details of 
RCCRO. We will use CRO to refer to both CRO and RCCRO 
hereafter. 




A. Molecule 

Molecules are the basic operating agents of CRO. In CRO, 
each optimization task is considered as a chemical reaction 
occurring in a closed container with a population of molecules 
and an energy buffer. The molecules in the container move 
and collide with the wall or with other molecules. With the 
collisions, the properties of molecules involved are changed, 
allowing the algorithm to explore the solution space. Each 
molecule possesses the following attributes: 

• A molecular structure refers to a feasible solution of 
the problem to be optimized. Each molecule possesses 
one molecular structure, which is modihed by different 
operators invoked in the elementary reactions. 

• Potential Energy (PE) stands for the quality of the solu¬ 
tion held by the molecule. In terms of optimization, PE 
is equivalent to the htness value of the solution. 

• Kinetic Energy (KE) stands for the tolerance of the 
molecule to accept a worse molecular structure compared 
to the current one in terms of the solution quality. A larger 
KE means that the molecule can accept a much worse 
molecular structure than those molecules with less KE 
values. 

Besides these properties, the molecules can also hold 
some other attributes to suit different optimization prob¬ 
lems. The implementation of these attributes can be problem- 
independent. 

B. Elementary Reactions 

In CRO, the optimization task, i.e. the chemical reaction, is 
tackled by four kinds of elementary reactions, including on- 
wall ineffective collision (Onwall), decomposition (Dec), inter- 
molecular ineffective collision (Inter), and synthesis (Syn). 
They occur sequentially and randomly to manipulate the 
structures of the molecules involved. Among them, Onwall 
and Dec takes one molecule as input while Inter and Syn 
takes two molecules. Onwall and Syn output one molecule 
based on the input molecule(s), while Dec and Inter output 
two molecules. Thus Dec and Syn can alter the total population 
size. This dynamic population size property is a feature that 
distinguishes CRO from other metaheuristics. 

1) Neighborhood Search Operator: In the canonical design 
of CRO, we use this neighborhood search operator as the 
basic molecular structure manipulatimg operator m. It is 
employed in Onwall, Dec, and Inter. This operator modifies 
one molecular structure using Gaussian perturbation value. 
Assume that the original molecular structure is oj, and the 
newly generated molecular structure is oj'. We first randomly 
choose a dimension i of a; to modify. Then a random number 
e is generated from a zero-mean Normal distribution whose 
variance is a user-defined parameter stepSize. Then the new 
molecular structure is generated by 

Wi = Wi + e (1) 

where uji stands for the i-th dimension of the molecular 
structure w. 


2) Elementary Reaction Operators: Based on the neighbor¬ 
hood search operator, we further designed the four elementary 
reaction operators. The detailed implementations are elabo¬ 
rated as follows. 

• An Onwall occurs when a molecule collides with the con¬ 
tainer and bounce back. During this elementary reaction, 
the structure of the involved molecule is manipulated 
using the neighborhood operator. The main purpose of 
this elementary reaction is to perform local search. 

• A Dec occurs when a molecule collides with the container 
and breaks into two new molecules. During this elemen¬ 
tary reaction, the structure of the input molecule is copied 
to the two new molecules. Then the new molecules go 
through a number of independent neighborhood opera¬ 
tors. The main purpose of this elementary reaction is to 
jump out of local optimum. 

• An Inter occurs when two molecules collide with each 
other and bounce back. In the canonical implementation 
of CRO, this elementary reaction is considered to be two 
onwalls occurring simultaneously. The main purpose of 
this elementary reaction is also to perform local search. 

• A Syn occurs when two molecules collide and merge 
into one new molecule. The detailed implementation of 
this elementary reaction can be found in El. The main 
purpose of this elementary reaction is to maintain the 
population diversity Q. 

C. Searching Pattern 

CRO is composed of three phases: initialization, iteration, 
and the final phase. In initialization, all algorithm parameters 
are initialized, and the initial population is randomly gen¬ 
erated. Then in the iteration phase, the algorithm manipu¬ 
lates the molecules to search for the global optimum in an 
iterative manner. In each iteration one elementary reaction 
is selected and conducted. This selection is controlled by 
the algorithm optimization parameters using a pre-defined 
deterministic scheme El- After the elementary reaction is 
selected, a corresponding number of molecules are randomly 
picked to participate in the reaction. These molecules are then 
manipulated and go through an energy check to determine 
whether the reaction succeeds or not, i.e. whether the changes 
are adopted. The energy check is elaborated in m and 0, 
and the underlying concept is the conservation of energy. This 
phase iterates until the stopping criterion is met. Then the 
algorithm proceeds to the hnal phase and the optimum results 
are output. Interested readers can refer to 0, 0, and 0 for 
elaboration of the algorithm and its pseudocode. 

III. Chemical Reaction Optimization with 
Adaptive Collision 

In this section we will elaborate our proposed inter- 
molecular adaptive collision scheme, which is composed of 
a new inter-molecular ineffective operator and an adaptive 
collision scheme. We call this algorithm CRO with Adaptive 
Collision (CRO/AC). In all discussions hereafter, without loss 
of generality, we only consider minimization problems. 


A. Inter-molecular Ineffective Collision Operator 

In the canonical design of CRO, the inter-molecular ineffec¬ 
tive collision is considered to be two on-wall ineffective colli¬ 
sions occurring simultaneously. However, this implementation 
renders the effects of these two operators overlapping. So we 
propose a new Inter operator to overcome this drawback. 

When an Inter takes place, two molecules are randomly 
selected from the current population to participate in the 
elementary reaction. Instead of conducting neighborhood op¬ 
erators on them as in canonical CRO, we first check their PE 
values, i.e. the fitness values of the solutions they hold. We 
use (jjs to denote the molecular structure of the molecule with 
a larger PE value, and ujt to denote the one with a smaller PE 
value. This implies that ujt is better than uJs in terms of the 
solution quality. 

After the two molecules are examined, we use a two-step 
approach to modify their structures. In the first step, we change 
UJs to make it more similar to ujt- This can be accomplished 
by using the following; 

^s,i — ^s^i) ^ C-i UJs^i-i iff) 

where ujg^i stands for the value of i-th dimension of Wg, w' ^ 
stands for the newly generated structure for Wg, and r; is a 
random number uniformly generated in [0,1). In this step, 
the random number is independently generated for each 
dimension. 

The second step is to change uJt to make it less similar to 
Wg, accomplished by; 

= i^t,z - Uj's,t) X + Wt.z- (3) 

The purpose of this design is to avoid pre-mature convergence 
and maintain the population density. The first step significantly 
reduces the population density, which may lead to pre-mature 
convergence. This second step increases the density by a small 
margin, and acts as a counter-measure of getting stuck in local 
optimums. We will demonstrate the necessity of this step in 
Section |lV] 

The remaining parts of the Inter operator are unchanged. 
The new molecules will go through the energy conservation 
test to check whether this Inter is deemed successful or 
not. If so, the changes made on these molecules, including 
molecular structures and molecule properties, are accepted. 
Otherwise these molecules remain unchanged. This ends an 
Inter elementary reaction for CRO. 

B. Adaptive Collision Scheme 

One main difference of our proposed Inter operator and the 
canonical design is that our operator can update the values 
of multiple dimensions in a solution. This operator is suitable 
for problems with large inter-dimensional correlations cni, 
but may have equal or even poorer performance on those 
problems with no such correlations. Thus the ratio of occur¬ 
rence of Onwall and Inter is critical to the performance. In 
the canonical design of CRO, this ratio is generally controlled 
by a user-defined parameter collision rate coll Rate |[T], and 



Fig. 1. Sigmoid Function Used in Adaptive Collision Scheme 


the value is usually set to be 0.2 Him. However, with the 
changes in the nature of Inter operator, this value is no longer 
appropriate and we shall tune the parameter to tailor-make the 
algorithm for different optimization problems, but this tuning 
process can be very time-consuming. So we further devise 
an adaptive collision scheme for CRO to control the ratio of 
collision adaptively, using the information feedback from the 
optimization process 112. 

In our adaptive collision scheme, we add a new attribute to 
the system, namely the number of successful inters, denoted 
counter. Initially, this attribute is set to zero, and at the 
beginning of each iteration, the value of coll Rate is calculated 
using the following sigmoid function; 


collRate = 


1 


1 -I- exp(—6 X 


counter \ ’ 
maxFE' 


(4) 


where maxFE is the maximum allowed number of function 
evaluations. The plot of this function is demonstrated in Eig. 
where the x-axis is the value of counter and the y-axis is the 
value of the corresponding collRate. The value of counter is 
updated whenever an Onwall or Inter occurs and succeeds. If 
a successful Onwall occurs, the value of counter is reduced 
by one. Otherwise the value is increased by one. In this way, 
the algorithm can adjust the collRate to favor either Onwall 
or Inter, to match the optimization problem being solved. 


C. Other Modifications 

In order to fully exploit the utility of our proposed inter- 
molecular collision scheme, we also make some other modi¬ 
fications to the implementation of the CRO framework. 

In the canonical CRO design, the algorithm does not impose 
any mandatory constraints on the elementary reaction selection 
until the size of the population is reduced to one. The 
selection is controlled by the optimization parameters. When 
the population size is one, neither Inter nor Syn would occur 
as they need at least two molecules as inputs. However this 
behavior may potentially reduce the occurrence of Inter and 




















TABLE I 

Benchmark Functions 


/ 

Function 

Solution Transformation* 

Name 

h 


Z = X — o 

Shifted Sphere Function 

h 


Z = X — o 

Shifted Schwefel’s Problem 1.2 

h 

h 


z = (x — 

z = M(x 

o) X 0.1 

- o) X 0.1 

Shifted Schwefel’s Problem 2.22 

Shifted Rotated Schwefel’s Problem 2.22 

/s 

— 20 exp ( — 0.2 a/ — N ^ 2 ?) — exp( — N ^ cos2-KZi) 

z = (x — 

o) X 0.32 

Shifted Ackley’s Function 

h 

+20 + e 

— 20 exp( —0.2\/ — N ' 2 ?) — exp( — N ' cos27r2i) 

z = M(x 

— o) X 0.32 

Shifted Rotated Ackley’s Function 


+20 + e 




f? 

418.9829D - ^ z; sin y^lzil 

z = X X 5 

Schwefel’s Problem 2.26 

fs 

418.9829D - ^ z; sin ^1^ 

z = Mx X 5 

Rotated Schwefel’s Problem 2.26 

f9 

'y ^ ( 2 ^ — 10cos27r2i + 10) 

z = (x — 

o) X 0.0512 

Shifted Rastrigin’s Function 

fio 

y ^ ( 2 ^ — 10cos27r2j + 10) 

z = M(x 

- o) X 0.0512 

Shifted Rotated Rastrigin’s Function 

fll 

2 D 

\ D 2- 1 1 Z-i 

-IT cos —hi 

= 1 4000 i 

z = (x — 

o) X 6 

Shifted Griewank’s Function 

fl2 

y 2- 1—|- Zi 

y -cos-hi 

4000 ^ 

z = M(x 

— o) X 6 

Shifted Rotated Griewank’s Function 

fl3 

sin^(7ryi) + [iVi - 1)^(1 + 10(sin^ yi+i))] + 

(s/n - 1)^(1 + sin^(27ry„)), j/i = 1 + j (z; + 1) 

z = (x — 

o) X 0.1 

Shifted Levy’s Function 

fl4 

sin^(7rj/i) + - 1)^(1 + 10(sin^ i/i+i))] + 

iVn - 1)^(1 + sin^(27ry„)), }/; = 1 + j (z; + 1) 

z = M(x 

- o) X 0.1 

Shifted Rotated Levy’s Function 

/15* 

i[sin^(37i-zi) + - 1)^(1 + sin^(37i-Zi+i)) + 

{zn — 1)^(1 + sin^(27r2„))] + ^ u{zi, 5, 100, 4) 

z = (x — 

o) X 0.5 

Shifted Penalized Function 1 

fl6* 

-[10sin^(7ryi) + Vyi - 1)^(1 + 10 sin^(7ryi+i)) + 

iyr^ - lf]+Y,"^u{zi,10,100,4),yi = l+-^(zi + l) 

z = (x — 

o) X 0.5 

Shifted Penalized Function 2 


* o is a shifting vector and M is a 

transformation matrix. ( 

f k{x - a)"* 

for X > a 

u(iE, a, k, m) = \ 0 

for — a < X < a. 

[k(-x - a)^ 

for X < —a 


can be obtained from (SI 


in return bias the ratio of Onwall and Inter. So we add a 
mandatory constraint to maintain this ratio. 

In CRO/AC, the elementary reaction selection scheme 
works identically to the canonical design of CRO in the first 
step, i.e. a random number is first generated and compared 
with coURate. If the random number is larger, either Onwall 
or Dec will occur. Otherwise, an Inter or Syn will take place 
and here we impose the second mandatory condition. If the 
current population size is no larger than two, all later selection 
steps are skipped and an Inter will occur. This modihcation 
can guarantee that the size of population is always larger than 
one, and there are always enough molecules in the container 
to perform an Inter elementary reaction. 

IV. Experimental Setting and Simulation Results 

In this section we will first introduce the benchmark func¬ 
tions adopted for performance evaluation and the experimental 
settings used. The simulation results, comparisons and discus¬ 
sions will also be presented. 


A. Benchmark Functions 

In order to evaluate our proposed CRO/AC, we conduct 
a series of simulations on 16 different benchmark functions. 
These benchmark functions are selected form the benchmark 
set proposed by Yao et al Cl and the latest benchmark prob¬ 
lem set for the competition on real-parameter single objective 
optimization at CEC 2013 ifTSl . The former benchmark set 
has been adopted for testing performance by a wide range 
of metaheuristics in recent years ca, and was adopted to 
test the performance of RCCRO 0. As revealed in Col, 
the current benchmark functions often suffer from two major 
problems; the global optimal points are located at the center 
of the search space, and the inter-dimensional correlation is 
weak. So we make a comprehensive test suite to resolve these 
problems by shifting and rotating some of the benchmark 
functions. The benchmark functions are listed in Table ID All 
benchmark functions are optimized in 30 dimensions, and 
the search spaces are dehned to be [—100,100]. The global 
optimum values of these benchmark functions are zero, and 







all simulation results smaller than 10“® are considered to be 
zero lfT3l . 

To evaluate the performance improvement of our proposed 
CRO/AC over CRO, we compare the simulation results be¬ 
tween these two designs. Lam et al. proposed three canonical 
CRO variants in Q, where the major differences among them 
are the constraint handling schemes and synthesis operators. 
We use CRO/BP, CRO/HP, and CRO/BB to refer to RCCROl, 
RCCR02, and RCCR03 described in jSj. We will compare the 
performance of CRO/AC with these three algorithms. 

CRO/AC and all the CRO variants are implemented in 
Python 2.7 on Microsoft Windows 7. All simulations are 
performed on a computer with an Intel Core 17-3770 @ 
3.4GHz CPU. In order to reduce statistical errors and generate 
statistically significant results, each benchmark function is 
repeated for 51 independent runs for each algorithm according 
to the suggestion by US). We use the maximum number 
of function evaluation (maxFE) as the termination criteria 
and maxFE is set to 300 000 for all benchmark functions, 
satisfying the requirement of 113. 

The parameters for all algorithms are set according to the 
recommendation of a for solving multimodal problems, i.e. 
population size is 20, stepsize is 1, initial energy buffer is 10®, 
initial kinetic energy for molecules is 10^, molecular collision 
rate is 0.2, kinetic energy loss rate is 0.1, decomposition 
threshold is 1.5 x 10®, and synthesis threshold is 10. 

B. Comparison of CRO/AC and Canonical CRO Variants 

The mean values, standard deviations, and Student’s t- 
test results obtained by CRO/AC and the three canonical 
CRO variants are presented in Table |I^ The mean values 
in bold indicate superiority of the corresponding algorithm 
over the others. The t-test results are the calculated t-statistic, 
where a negative value means that CRO/AC outperforms the 
corresponding algorithm. The t-test values in italic indicate 
that the advantage is significant at a confidence level of 95%. 
From the simulation results the following key points can be 
observed: 

• CRO/AC performs better than all canonical CRO variants 
in most of the tested benchmark functions when compar¬ 
ing the mean simulation results. CRO/AC outperforms 
the others in 14 functions, and its performance in the 
remaining two functions (/n and / 12 ) are comparable to 
the CRO variants. 

• The t-test results further support our previous observation. 
CRO/AC outperforms other algorithms in all but three 
functions (/ 4 , /n and / 12 ). In f^, CRO/AC outper¬ 
forms CRO/HP and performs similarly with CRO/BP 
and CRO/BB. In the meantime CRO/AC generates more 
stable simulation results. In /n, CRO/AC generates a 
slightly worse mean result, but the t-test results indicate 
no significant advantage of the other algorithms. 

In terms of the computational time, a very small amount 
of additional time is required for our inter-molecular adaptive 
collision scheme. The total extra time is around 2%-7% of the 
computational time needed by the canonical CRO variants. As 


TABLE II 

Simulation Results of CRO/AC and Canonical CRO Variants 


Function 

CRO/AC 

CRO/BP 

CRO/BB 

CRO/HP 

/i 

Mean 

Std. Dev. 
T-test 

4.2111e-07 

3.4578e-07 

2.7374e-06 

1.5487e-06 

-10.3216 

2.60096-06 

1.22656-06 

-12.0957 

2.66846-06 

1.43866-06 

-10.7402 

h 

Mean 

Std. Dev. 
T-test 

8.0285e-06 

7.1100e-06 

1.8280e-05 

8.4089e-06 

-6.5827 

1.86906-05 

9.38146-06 

-6.4043 

1.92486-05 

9.96516-06 

-6.4804 

/3 

Mean 

Std. Dev. 
T-test 

1.2540e-04 

5.1818e-05 

5.2846e-04 

1.2148e-04 

-21.5802 

6.29566-04 

1.63746-04 

-20.7578 

5.97676-04 

1.38296-04 

-22.6129 

fi 

Mean 

Std. Dev. 
T-test 

3.97280-1-01 

1.98916-1-01 

1.29446-1-07 

7.02066-1-07 

-1.3037 

4.62106-1-06 

3.02366-1-07 

-1.0807 

6.85126-1-06 

2.35996-1-07 

-2.0528 

/a 

Mean 

Std. Dev. 
T-test 

7.55710-1-00 

6.6117e-01 

1.15036-1-01 

5.57336-01 

-32.2656 

1.11776-1-01 

6.61926-01 

-27.3574 

1.13056-1-01 

6.60296-01 

-28.3605 

/6 

Mean 

Std. Dev. 
T-test 

7.86820-1-00 

8.0475e-01 

1.13886-1-01 

7.08356-01 

-23.2181 

1.12316-1-01 

6.69926-01 

-22.7117 

1.15626-1-01 

5.55146-01 

-26.7181 

/? 

Mean 

Std. Dev. 
T-test 

O.OOOO 0 - 1 -OO 

O.OOOOe-hOO 

5.82316-1-03 

6.11786-1-02 

-67.3051 

6.12066-1-03 

7.89316-1-02 

-54.8319 

6.06726-1-03 

6.61526-1-02 

-64.8529 

h 

Mean 

Std. Dev. 
T-test 

O.OOOO 0 - 1 -OO 

O.OOOOe-hOO 

5.75276-1-03 

6.75616-1-02 

-60.2089 

5.63086-1-03 

1.17706-1-03 

-33.8292 

5.59736-1-03 

6.47956-1-02 

-61.0824 

fo 

Mean 

Std. Dev. 
T-test 

I. 34 OO 0 - 1 -O 2 

2.9142e-hOI 

4.21716-1-02 

7.85726-1-01 

-24.2770 

3.89416-1-02 

8.40376-1-01 

-20.3045 

4.33846-1-02 

8.47716-1-01 

-23.6523 

fio 

Mean 

Std. Dev. 
T-test 

1.43830-1-02 

3.9544e-h01 

4.35666-1-02 

8.90856-1-01 

-21.1713 

4.16326-1-02 

8.82946-1-01 

-19.9162 

4.50596-1-02 

9.00046-hOl 

-22.0647 

fll 

Mean 

Std. Dev. 
T-test 

2.79916-1-00 

3.44176-1-00 

2.30646-1-00 

2.81456-1-00 

0.7837 

2.61686-1-00 

2.63766-1-00 

0.2972 

2.1902e-H00 

2.46516-1-00 

1.0171 

/12 

Mean 

Std. Dev. 
T-test 

1.0817e-02 

1.2490e-02 

4.76486-03 

1.23586-02 

2.4357 

4.05426-03 

6.65096-03 

3.3796 

1.98070-03 

4.36936-03 

4.7222 

/l3 

Mean 

Std. Dev. 
T-test 

2.80920-1-00 

2.80736-1-00 

1.94286-1-01 

2.46616-1-01 

-4.7344 

1.02516-1-01 

1.13976-1-01 

-4.4832 

1.20366-1-01 

1.35046-kOl 

-4.7302 

/l4 

Mean 

Std. Dev. 
T-test 

5.23330-1-00 

5.6115e-i-00 

3.75366-1-01 

4.20156-1-01 

-5.3885 

6.93196-1-01 

4.39516-1-01 

-10.2274 

3.81916-1-01 

3.89176-1-01 

-5.9271 

/l5 

Mean 

Std. Dev. 
T-test 

5.76470-08 

1.7199e-07 

2.61106-07 

2.05796-07 

-5.3640 

2.11216-07 

1.92436-07 

-4.2072 

2.30936-07 

1.82606-07 

-4.8848 

/16 

Mean 

Std. Dev. 
T-test 

7.44780-1-00 

6.9020e-h00 

1.66336-1-01 

1.18066-1-01 

-4.7492 

6.92646-kOO 

7.31146-1-00 

0.3667 

1.54816-1-01 

9.81986-1-00 

-4.7324 


the benchmark functions we adopt are relatively less compu¬ 
tationally intensive compared with most real-world problems, 
we believe that the extra time used by CRO/AC is not critical 
considering the significant performance improvement. 

C. Analysis on the Two-step Inter-molecular Ineffective Col¬ 
lision Operator and Adaptive Collision Scheme 

Section [m] introduced our proposed inter-molecular inef¬ 
fective collision operator, which is a two-step manipulation 
method. In this section we will show the necessity of incorpo¬ 
rating the second step, i.e. 0- We construct a CRO/AC variant 
with one-step inter-molecular ineffective collision operator 
(CRO/AC/1 step) which removes the second step of manip¬ 
ulating the input molecules. We also proposed an adaptive 
collision scheme which adaptively changes the value for the 
molecular collision rate. We construct CRO/AC/0.2 which 
sets the collision rate constantly to 0.2 during the entire 
search process. The same experimental settings and benchmark 





















TABLE III 

Simulation Results of CRO/AC variants 


Function 

CRO/AC 

CRO/AC/0.2 

CRO/AC/lstep 


Mean 

4.2111e-07 

8.9465e-08 

3.8261e-07 

/i 

Std. Dev. 

3.4578e-07 

6.9765e-0S 

2.7951e-07 


T-test 

- 

6.6481 

0.6123 


Mean 

8.0285e-06 

2.1730e-06 

1.3225e-05 

/2 

Std. Dev. 

7.1100e-06 

2.1997e-06 

7.9482e-06 


T-test 

- 

5.5633 

■3.4455 


Mean 

1.2540e-04 

6.0034e-05 

1.9051e-04 

h 

Std. Dev. 

5.1818e-05 

2.3344e-05 

5.8835e-05 


T-test 

- 

8.1321 

-5.8727 


Mean 

3.9728e-H01 

2.3252e-k04 

9.4010e-F01 

h 

Std. Dev. 

1.9891e-i-01 

1.15026-1-05 

4.1884e-F01 


T-test 

- 

-1.4270 

-8.2781 


Mean 

7.5571e-H00 

9.19276-1-00 

8.3137e-F00 

h 

Std. Dev. 

6.6117e-01 

8.0608e-01 

6.7715e-01 


T-test 

- 

■11.0930 

-5.6529 


Mean 

7.8682e-h00 

9.45006-1-00 

8.51556-1-00 

h 

Std. Dev. 

8.0475e-01 

7.2286e-01 

6.8856e-01 


T-test 

- 

-10.3400 

-4.3216 


Mean 

O.OOOOe-hOO 

6.7445e-h02 

6.6541e-F03 

fj 

Std. Dev. 

O.OOOOe-hOO 

1.35516-1-03 

7.5036e-F02 


T-test 

- 

-3.5193 

-62.7052 


Mean 

O.OOOOe-hOO 

3.79146-1-02 

6.6298e-F03 

h 

Std. Dev. 

O.OOOOe-kOO 

1.0612e-i-03 

8.1775e-F02 


T-test 

- 

-2.5264 

-57.3279 


Mean 

1.3400e-h02 

2.11406-1-02 

1.9889e-h02 

/q 

Std. Dev. 

2.91426-1-01 

4.7866e-i-01 

3.8175e-F01 


T-test 

- 

■9.7669 

-9.5546 


Mean 

1.4383e-H02 

2.0337e-h02 

2.1631e-F02 

/lO 

Std. Dev. 

3.9544e-h01 

5.4420e-h01 

4.2253e-F01 


T-test 

- 

-6.2583 

-8.8565 


Mean 

2.7991e-h00 

4.4066e-01 

7.3760e-F00 

/ll 

Std. Dev. 

3.4417e-k00 

8.6072e-01 

5.0705e-F0O 


T-test 

- 

4.7007 

-5.2810 


Mean 

1.0817e-02 

1.0379e-02 

1.1223e-02 

/12 

Std. Dev. 

1.2490e-02 

1.3075e-02 

1.6374e-02 


T-test 

- 

0.1712 

-0.1393 


Mean 

2.8092e-F00 

6.3203e-i-00 

6.6642e-F00 

/13 

Std. Dev. 

2.8073e-i-00 

8.2816e-i-00 

9.43S9e-F00 


T-test 

- 

-2.8391 

-2.7681 


Mean 

5.2333e-H00 

1.98076-1-01 

7.4475e-F00 

/l4 

Std. Dev. 

5.6115e-i-00 

2.2535e-h0i 

1.1233e-F01 


T-test 

- 

-4.4374 

-1.2469 


Mean 

5.7647e-08 

1.1126e-08 

9.2002e-08 

/l5 

Std. Dev. 

1.7199e-07 

3.2826e-0S 

1.6632e-07 


T-test 

- 

1.8787 

-1.0153 


Mean 

7.4478e-H00 

1.27156-1-01 

1.7369e-F01 

fl6 

Std. Dev. 

6.9020e-h00 

1.0369e-i-01 

1.4167e-F01 


T-test 

- 

-2.9904 

-4.4514 


functions are applied to these algorithms, and the simulation 
results are presented in Table m From these test results, we 
have the following observations; 

• Both the two-step manipulation method and the adap¬ 
tive collision scheme contribute to the performance 
improvement of CRO/AC. CRO/AC generates 10 best 
mean values among the 16 benchmark functions while 
CRO/AC/0.2 produces the best mean values pf the other 
six. 

• CRO/AC/0.2 tends to generate outstanding results in 
the uni-modal optimization functions (/ 1 -/ 4 ), while 
CRO/AC is generally superior at solving multi-modal 
functions (/ 5 -/ 16 ) 

• The less competitive results generated by CRO/AC/lstep 
are potentially due to pre-mature convergence, which is 
caused by missing the second step manipulation that 
allows molecules to jump out of local optima. 



Fig. 2. coll Rate Changes of fi and /n 


The effect of the adaptive collision scheme can also be 
revealed by Fig. where the changes on collRate of /i 
and /5 are plotted. From the figure we can see the adaptive 
scheme can adjust collRate to different values according to 
the feedback from the optimization process. 

V. Conclusion 

CRO is a recently proposed simple and powerful meta¬ 
heuristic optimization method which mimics the interactions 
and transformations of molecules in chemical reactions to 
search for the global optimum. CRO has been applied to solve 
both combinatorial and continuous optimization problems. In 
the canonical design of CRO for solving continuous opti¬ 
mization problems, the functionalities of on-wall ineffective 
collision and inter-molecular ineffective collision overlap, and 
this potentially hampers the performance of CRO. In this 
paper we propose a novel inter-molecular operator to overcome 
this drawback. This operator changes the values on multiple 
dimensions of a solution at one time, and is more efficient 
at solving problems with strong inter-dimensional correlation 
than the canonical design. In order to fully utilize the different 
optimization features of this new operator, we also devise an 
adaptive collision scheme to control the ratio of different ele¬ 
mentary reactions. This scheme learns from the optimization 
feedback and adjusts the collRate parameter of CRO to adapt 
the algorithm to different problems. We incorporate the new 
operator and the adaptive scheme into the CRO framework 
and propose a new algorithm CRO/AC. 

To examine the performance improvement of CRO/AC over 
canonical CRO, we perform a series of simulations on a wide 
range of different benchmark functions. The simulation results 
indicate the superiority of our proposed CRO/AC over all the 
compared CRO variants. We also analyze the performance 
improvement contribution made by the new operator and the 
adaptive scheme, and find both of them are essential for 
CRO/AC to achieve better performance than the canonical 
CRO. 




























In the future we will perform a systematic analysis on 
the parameter selection for CRO/AC. All simulation in this 
paper adopted the parameter settings devised in 0, which 
was originally designed for the canonical CRO and may be not 
suitable for CRO/AC. It is also an interesting topic to combine 
CRO/AC with the stepSize adaptation scheme proposed in 
0. Last but not least, we will apply CRO/AC to real-world 
practical optimization problems to perform an overall study of 
the performance of CRO/AC. 
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